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Serial Number: 08/720,3 73 Page 2 

Art Unit: 2741 (formerly 2308) 

DETAILED ACTION 

Response to Amendment 

1 . In response to the Office Action mailed August 6, 1997, applicants have submitted an 
Amendment and Response, filed February 13, 1998, affirming the oral election made on July 7 to 
prosecute the invention of Group I claims, canceling claims 57-62 without prejudice, amending 
claims 1-32, 34-42 and 52, and adding new claims 63-97 without introducing new matter, and 
have submitted a Test Report of NCC Digital Dictate Release 2.3 and an extract from the 
November 1997 Technology Insider as exhibits for arguing patentable differences between the 
cited prior art and the pending amended or newly added claims. This response has placed the 
application in position for allowance, for reasons given below under Allowable Subject Matter. 

Allowable Subject Matter 

2. Claims 1-42, 52 and 63-97 are allowable over the prior art of record and thus are allowed. 
The following is an examiner's statement of reasons for allowance: 

As per amended independent claims 1 (for an apparatus), 13 (for a data processing 
arrangement), 23 (for the underlying method) and 52 (for a computer usable medium storing the 
instructions to realize its functionality), they recite an interface application program means or 
program which determines positions of words and forms link data (audio identifiers and the 
determined word or character positions) relating the words or characters to their corresponding 
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audio segments for automated proofreading, and monitors changes of recognized words (words 
moved, reordered, deleted, inserted or formatted) in a wordprocessing application, updating their 
link data as the text of recognized words is modified by said application program. As applicants 
argue, the prior art having link data, specifically Digital Dictate Release 2.3 (applicants' Test 
Report) and IBM Voice Type LI (Specification, p. 2), use the application program's own 
features (bookmarking in MS Word) to determine word positions and update said linking, rather 
than having this done in an application-independent interface that is not dependent of 
wordprocessor capabilities. 

The examiner notes in passing that applicants' assertion that the IBM Automatic Indexing 
application (EP 0 649 144, also issued as Hamed A. Ellozy et al., U.S. Patent 5,649,060) "does 
not disclose a system... concerned with allowing for the correction of mis-recognized text output 
from a speech recogniser by allowing user to select and play back audio data" (Petition to Make 
Special, Paper No. 6, p. 4), is not strictly correct. For, Ellozy et al. point out that "The method 
can be used...(c) to enhance editing of a text that was dictated to a stenographer or recorded on a 
tape for its subsequent textual reproduction for a typist" (Abstract), and teach that "Instead of 
typing, the text may be produced using... a speech recognizer" (col. 5, lines 16-18). However, this 
does not affect the novelty of the "link data approach" (linking audio identifiers to the 
corresponding word or character positions) in the instant application, as compared with the IBM 
"index word" approach, wherein each link data pair consists of the word (or phrase) itself (rather 
than its location in the transcript) and the audio identifier (a number describing the "time stamp" 
position of the word in storage or in the recording). 
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Since amended dependent claims 2-12, 80, 82; 14-22, 42, 81 and 83; and 24-41 and 84- 
87 further limit claims 1,13 and 23, respectively, or their parent claims, they are allowable also. 
Note that the Examiner's Amendment has amended an error in line 1 of claim 83. 

As per new claims 63-70 they incorporate the subject matter identified as allowable in the 
discussion of the original claims 10-1 1, 17-18, 32-33 and 39-40, in paragraph 8 of the previous 
Office Action (Paper No. 9). Namely, it recites selectively disabling the importation of recognized 
characters or of dictated speech recognition for a period of time for the purpose of storing an 
audio message to an editor or proofreader (instructions or a reminder, rather than merely author's 
textual emendations or instructions to enter such textual emendations, as in prior art), associated 
with the file of recognized characters from author's dictation, for later playback. In addition, it 
separately recites a link means for forming link data, linking audio identifiers and the determined 
character component positions in the processed text, and monitoring character changes after 
processing and updating the link data thereof, for automated proofreading. 

As per new independent claim 71, it recites an universal application-independent speech- 
recognition interface that can output the recognized words for text-processing into any one of a 
plurality of different computer applications, and which allows playback of audio data associated 
with said words for automated proofreading. Since the prior-art speech-recognition interfaces 
such as those of Digital Dictate or IBM Voice Type are application-specific, as applicants argue 
(see above), it is allowable. 
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Since new dependent claims 72-74 further limit claim 71, they are allowable also. 

As per new independent claim 75, it recites a speech-recognition interface independent of 
the computer-related application having means for outputting recognized words into an 
application program for text-processing, which interface independently determines positions of the 
recognized words in said application. Since the prior art uses the word-processing application 
itself to keep track of word positions, as applicants argue (see above), it is allowable also. 

Since new dependent claims 76-79 further limit claim 75 or their parent claim, they are 
allowable also. 

As per new independent claims 88 (for a data processing apparatus), 90 (for its underlying 
method, and 92 (for a computer usable medium to implement its functionality), they recite an 
interface for receiving speech recognition data that inputs recognized words into a word- 
processing application program and forms link data, linking audio data via audio identifiers to 
their recognized words as the words are moved by the processing application, for automated 
proofreading playback of selectively identified displayed recognized words. Since, as applicants 
argue, prior art does not have such functions in an interface application but depends on the 
wordprocessing application to maintain the linking, the claims are allowable. 

As per new dependent claims 89, 91 and 93, they further limit claims 88, 90 and 92, 
respectively, and thus are allowable also. 
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As per new independent claims 94 (for an apparatus) and 96 (for its underlying method), 
they recite a separate second application program which determines the positions of the 
recognized words input into a first application program, linking them to their audio data, and 
updates the link data (audio identifiers and the corresponding word positions) in response to 
monitored changes in recognized word positions as the words are processed thereby. Again, 
since, unlike prior art (per applicants' argument), a separate application handles the forming of the 
link data (audio identifiers and determined recognized word positions) and updates the link data 
upon changes in the position of recognized words, for automated proofreading, the claims are 
allowable. 

As per new dependent claims 95 and 97, they further limit claims 94 and 96, respectively, 
and thus are allowable also. 

Thus all pending claims (claims 1-42, 52 and 63-97) are allowed. 

3. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 



Examiner's Amendment 
4. An examiner's amendment to the record appears below. 
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Change the title of the invention to —Automated Proofreading Using Interface Linking 
Recognized Words to their Audio Data While Text is Being Changed—. 

In claim 83, line 1, replace "apparatus" by the intended -arrangement—, as authorized in 
a telephone interview with applicants' representative Ann S. Viksnins on March 19, 1998. 

5. Should the changes and/or additions be unacceptable to applicant, an amendment may be 
filed as provided by 37 CFR 1.312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Conclusion 

6. The application having been allowed, new formal drawings are required in response to this 
Office action so as to overcome Draftsperson's objections on Form PTO 948, attached to this 
Office Action (since it was not sent with the previous Office Action due to a clerical error). 

Formal drawings must be filed within the THREE MONTH shortened statutory period set 
for reply in the "NOTICE OF ALLOWABILITY" (PTOL-37 or PTO-37). Extensions of time 
may be obtained under the provisions of 37 CFR 1.136(a). Failure to timely submit the drawings 
will result in ABANDONMENT of the application. 

The drawings should be submitted as a separate paper with a transmittal letter which is 
addressed to the Official Draftsperson. The art unit number, application number and number of 
drawing sheets should be written on the reverse side of the drawings. 
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7. Any response to this allowance should be mailed to: 

Box Issue Fee 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or FAXed to: 

(703) 308-9051, (for formal communications; please mark "EXPEDITED 

PROCEDURE") 

or: 

(703) 305-9508 (for informal or draft communications, please label 
"PROPOSED" or "DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington. VA., Sixth Floor (Receptionist). 

8. Any inquiry concerning this communication should be directed to the examiner, Talivaldis 
Ivars Smits, whose telephone number is (703) 306-301 1 . The examiner can normally be reached 
Mondays-Fridays from 8:00 a.m. to 4:30 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
David R. Hudspeth, can be reached on (703) 308-4825. The facsimile phone number for this 
Group Art Unit is (703) 305-9508. With the consolidation into Technology Center 2700, 
effective November 16, 1997, the former Art Unit 2308 has become Art Unit 2741. 

Any inquiry of a general nature or relating to the status of this application should be 
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directed to the Technology Center receptionist, whose telephone number is (703) 305-3900. 



Dr. Talivaldis Ivars Smits 
Patent Examiner 
Art Unit 2741 
March 19, 1998 



